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Hanford  Tank  Waste  Cleanup  Challenge 


Hanford  has: 

•  63%  of  DOE  tanks;  80%  of  DOE 
single-shell  tanks 

•  58%  of  DOE  total  tank  waste 

•  -194  million  curies  of 
radioactivity 

•  -1 90,000  tons  of  chemicals 


Total  Number  of  Gallons  in 
Waste  Tanks  at  DOE  Sites: 


Idaho 
1.4  Million 


Single  Shell  Tanks  (SSTs)  under  Construction 


Double-Shell  Tanks  (DSTs)  under  Construction 


Waste  Treatment  Plant  (WTP) 


Hanford’s  WTP  will  be  the  world’s  largest  radioactive  waste  treatment 
plant  to  treat  Hanford’s  underground  tank  waste 


Major  Facilities 

1 .  Pretreatment  (PT)  Facility 

2.  Low  Activity  Waste  (LAW) 
Vitrification  Facility 

3.  High  Level  Waste  (HLW) 
Vitrification  Facility 

4.  Analytical  Laboratory 

5.  Balance  of  Facilities 


Commodities 

Concrete 
Structural  Steel 
Pipe 
HVAC 
Cable  Tray 
Conduit 


90,000  CY 
10,000  Ton 
160,000  ft 
1,200  Ton 
40,000  ft 
220,000  ft 
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WTP  Flow  Sheet  -  Key  Process  Flows 
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How  is  the  Vitrified  Waste  Dispositioned? 


High  Level  Waste  Canisters - 

•  2’ x  14.5’ 

•  6,600  pounds  of  glass 

•  600  canisters  to  be  produced/year 

•  Temporarily  stored  in  Hanford’s 
Canister  Storage  Building  until  National 
Repository  opened 

Low  Activity  Waste  Containers  _ 

•  4’  x  7.5’ 

•  1 3,000  pounds  of  glass 

•  1 ,300  containers  to  be  produced/year 

•  Disposed  on  Hanford  Site 
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Aerial  View  of  the  Waste  Treatment  Plant 
$12.2  B  2019  Completion 


Pretreatment  Facility  -  July  2007 


Pretreatment  Facility  5  Stories  (O’,  28’,  56’,  77’,  98’) 

Design  70%  Complete  [  250’  Wide  x  558’  Long  +  28’  wide  loading  bay/dock 

Construction  25%  Complete  fl  H9’  Tall  (Top  of  Basemat  at  Grade  to  Roof) _ 


Feed  Receipt  Vessels  in  Fabrication-2004 


Feed  Receipt  Vessels  (4) 

•  Largest  Vessels  in  Pretreatment 

•  Batch  Volume  375,000  gal 

•  Diameter  47  ft,  Height  43  feet 


Pretreatment  Black  Cell  and  Hot  Cell 


•  Permanent  equipment  installed  in 
Black  Cell 

-  15  Black  Cells 

•  Equipment  requiring  maintenance 
installed  in  Hot  Cell- 
maintainable/replaceable  area 

•  Design  concept  allows  insertion  of 
new/modified  technologies  at  later 
date 
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HLW  Vitrification 


HLW  Vitrification  Facility 

4  Stories  (O’,  14\  37\  58’) 

Design  79%  Complete 

281’  Wide  x  448’  Long 

Construction  20%  Complete 

120’  Tall  (Bottom  of  Basemat  @  -21’  to  Roof) 
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LAW  Vitrification 


LAW  Vitrification  Facility 
Design  93%  Complete 
Construction  48%  Complete 


Analytical  Laboratory 


Background  for  WTP  TRAs 


•  GAO  initiated  review  of  DOE  projects  in  2006 
to  assess  relationship  between  technology 
maturity  and  project  cost  growth  and 
schedule  extension 

-  12  DOE  projects  reviewed-WTP  included 

-  Concluded  that  implementing  immature 
technology  in  design  was  part  of  the  reason 
for  cost  growth 

-  Recommended  that  DOE  use  a  consistent 
process  for  measuring  readiness  of  critical 
technologies 

-  DOE  supports  GAO’s  recommendation  and 
suggested  a  pilot  application  to  understand 
process 


United  States  Government  Accountability  Office 

GAO 

Report  to  the  Subcommittee  on  Energy 
and  Water  Development,  and  Related 
Agencies,  Committee  on 

Appropriations,  House  of 
Representatives 

Mnreh  2007 

DEPARTMENT  OF 
ENERGY 

Major  Construction 
Projects  Need  a 
Consistent  Approach 
for  Assessing 
Technology  Readiness 
to  Help  Avoid  Cost 
Increases  and  Delays 

As  a  0 

.  Accaunflolillity  '  Integrity  '  Reliability 

GAO07-336 

In  late  2006  DOE  initiated  3  Technology 
Readiness  Assessments  for  WTP 
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WTP  TRAs  Status 


Three  TRA’s  Completed  for  WTP 


Technology  Readiness  Assessment  for  the  Waste 
Treatment  and  Immobilization  Plant  (WTP)  Analytical 
Laboratory,  Balance  of  Facilities  and  LA  W  Waste 
Vitrification  Facilities,  07-DESIGN-042,  U.S.  Department  of 
Energy,  Richland,  Washington 

Technology  Readiness  Assessment  for  the  Waste 
Treatment  and  Immobilization  Plant  (WTP)  HLW  Waste 
Vitrification  Facility,  07-DESIGN-046,  U.S.  Department  of 
Energy,  Richland,  Washington 

Technology  Readiness  Assessment  for  the  Waste 
Treatment  and  Immobilization  Plant  (WTP)  Pretreatment 
Facility,  07-DESIGN-047,  U.S.  Department  of  Energy, 
Richland,  Washington 


Technology  Maturation  Plan  Completed 


rywroHr-raj-ro 


Technology  Maturation  Plan  - 
Technology  Readiness  Assessment  Reports  for 
the  Waste  Treatment  and  1m mobilization  Plant 
Project  Faculties 
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Purpose  of  the  WTP  TRAs 


•  Assess  the  maturity  of  Critical  Technology  Elements  to: 

-  Determine  readiness  of  proceeding/continuing  with  design  and 
construction 

-  Identify  immature  technologies  and  components  (for  tracking  of  maturity 
of  development) 

-  Identify  technology  development  needs  for  immature  technologies 

•  Apply  and  refine  TRL  process  for  potential  use  by  EM 
Design/Construct  Projects 
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Methodology  for  Completion  of  TRAs 


TRAs  based  upon  method  described  in 
Department  of  Defense,  Technology  Readiness 
Assessment  (TRA)  Handbook,  May  2005 

Steps  in  TRA 

1 .  Identification  of  Critical  Technology  Elements 
(CTEs) 

2.  Completion  of  TRL  Assessment  for  each  CTE 

3.  Completion  of  Technology  Maturation  Plan  for 
technologies  with  TRL  less  than  6 
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WTP  TRA  Approach  (1) 


Critical  Technology  Element  determination  completed  in  2  steps 

•  Candidate  CTE’s  identified  by  Assessment  Team 
(DOE/Independent  Contractor) 

•  Final  determination  made  with  WTP  Contractor  support  using 
DoD  criteria 

Revision  of  TRL  Level  definitions  for  Radiochemical  Processing 

•  Comparison  of  NASA,  DoD  and  DOE-EM  scale  prepared 

TRLs  determined  using  modified  “Nolte”  calculator  (Level  1-6) 

•  All  criteria  to  be  met  to  complete  level 

•  Software  systems  not  evaluated 
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WTP  TRA  Approach  (2) 


Process  involved  due-diligence  prior  to,  during,  and  following  TRL 
scoring 

•  Treated  criteria  scoring  as  a  “finding  of  fact” 

•  WTP  Contractor  involving  in  initial  scoring 

•  Final  scoring  done  following  additional  due  diligence  by 
Assessment  Team 

TRA  Report  provided  to  WTP  Contractor  for  factual  accuracy 
review. 

Technology  Maturation  Plan  prepared  for  CTEs  <  6 
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Technology  Readiness  Level  Scale-Summary  Level 


System 

Operations 


System 

Commissioning 


Technology 

Demonstration 


Technology 

Development 


Research  to  Prove 
Feasibility 


Basic  Technology 
Research 


TRL  9 

TRL  8 

TRL  7 

TRL  6 


TRL  5 

TRL  4 

TRL  3 

TRL  2 

TRL  1 


Actual  equipment/process  successfully  operated  in  the  operational 
environment  (Hot  Operations) 

Actual  equipment/process  successfully  operated  in  a  limited  operational 
environment  (Hot  Commissioning) 

Actual  equipment  system/process  system  successfully  operated  in  the 
expected  operational  environment  (Cold  Commissioning) 

Prototypical  equipment/process  system  demonstrated  in  a  relevant 
environment  (Cold  Engineering  Scale  Pilot  Plant) 

Bench  scale  equipment/process  system  demonstrated  in  a  relevant 
environment 

Laboratory  testing  of  similar  equipment  systems  completed  in  a  simulated 
environment. 

Equipment  and  Process  analysis  and  proof  of  concept  demonstrated  in  a 
simulated  environment 

Equipment  and  process  concept  formulated 


Basic  process  technology  principles  observed  and  reported 


TRL  6  normally  required  for  incorporation  of  technology  into  design 
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Technical  Readiness  Assessment  Summary 


Facility 

Number  of  Systems 
considered  in  TRA  as 
Potential  CTEs 

Number  of  CTEs 
selected  for  Detailed 
Maturity 

Assessment 

Number  of  CTEs 
with  a  Technology 
Maturity  Level  less 
than  6 

Pretreatment 

33 

9 

9 

Analytical  Laboratory 

20 

1 

1 

Balance  of  Facilities/WTP 
Common 

70 

1 

0 

LAW  Vitrification 

33 

5 

2 

HLW  Vitrification 

30 

5 

2 

Total 

186 

21 

14  (8  a) 

a  Common  mixing  issues  were  identified  for  the  following  systems:  Cesium  Ion  Exchange  Process  System  (CXP),  Waste  Feed  Evaporation 
Process  System  (FEP),  Waste  Feed  Receipt  Process  System  (FRP),  HLW  Melter  Offgas  Treatment  Process  System  (HOP),  HLW  Lag 
Storage  and  Feed  Blending  Process  System  (HLP),  Treated  LAW  Evaporation  Process  System  (TLP),  and  Plant  Wash  and  Disposal  System 
(PWD)/Radioactive  Liquid  Waste  Disposal  System  (RLD). 
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Development  of  Technology  Maturation  Plan 


•  CTE’s  <  6  were  subjected  to  risk 
assessment  to  determine  impact  if  not 
matured 


•  CTEs  with  significant  consequence 
required  technology  maturation  plans 


•  CTE  <  4  required  identification  of 
alternative  technology 


•  Principles  of  Systems  Engineering 
and  Value  Engineering  used  in 
Development  of  Maturation  Plan 

-  Reassessment  of  Requirements 

-  Reassessment  of  Functions 
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WTP  Systems  Requiring  Maturation 


Pulse  Jet  Mixing 

Waste  Solids  Separation 

Radioactive  Cesium  Removal 

Nitric  Acid  Recovery  and  Recycle 

Laser  Ablation-Inductivity  Coupled 
Plasma-Atomic  Emission 
Spectrometer 


•  HLW  Melter  Offgas  Treatment 
(Electrostatic  Precipitator) 

•  LAW  Container  Sealing 

•  LAW  Container  Decontamination 


Current  Detijn 
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Technology  Maturation  Sequence  and  WTP  Critical  Decisions 


DOE’s  Project  Management  Process  as  Applied  to  WTP 


CD-0 

Approve 

Mission 

Nee<± 


1996 


CD-I  Approve 

CD-2  Approve 

CD-3 

CD-4 

Initial  Schedule 

Performance 

Approve 

Approve 

and  Cost  Range 

Baseline 

Start  of 

Start  of  Hot 

Construction 

1 

Operations 

1998 

2000 

2002 

2019 

▼ 

▼ 

▼ 

T 

Preconceptual 

Design 

Conceptual  Design 

Preliminary  Design 

Detailed  Design 

Final  Design 

Facility  Construction 


Technology  Installation/Acceptance 


Testing/Cold  Commissioning 


Technology  Maturation 


WTP  Design  Build  Approach  allows  Technology  Maturation  at  later  stage  in  Project 
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Alignment  of  DOE  Critical  Decision  Milestones  with  TRLs 


•  WTP  design  concept  is  flexible  and  supports  technology 
insertion  (new/modified  technology)  after  start  of 
Construction 

•  Small  number  of  CTEs  rated  less  than  TRL  6 

-  186  potential  CTEs  were  identified 

-  21  CTEs  were  selected  for  detailed  evaluation 

-  14  of  186  CTEs  were  rated  less  than  TRL  6  (7.5%) 

-  Mixing  issues  were  combined  resulting  in  8  CTEs  for  maturation 

•  Cost  of  WTP  delay  would  exceed  cost  risk  of  maturation 

-  Maturity  schedule  will  be  managed  within  the  current  construction 
schedule 
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Actions  to  Ensure  Consistency  with  DoD  TRA  Process 


•  DoD  TRA  Deskbook  used  as  guide 

•  NASA/DoD  TRL  definitions  used  with  minor  modification 

-  Adapted  to  waste  treatment 

•  Consultation  with  Bill  Nolte  of  the  Air  Force  Research 
Laboratory  (AFRL) 

-  Participated  with  DOE  Assessment  Team  in  initial  TRA 

-  Supported  modification  and  use  of  AFRL  TRL  Calculator  (originated  by 
Nolte)  to  ensure  consistency  with  NASA/DoD  scoring 

•  Independent  review  of  WTP  Technology  Maturation  Plan 
by  Nolte  (AFRL)  and  Bilbro  (NASA  Technology-retired) 
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Observations  on  TRA  Process 


•  DoD  TRA  provides  structured,  objective  and  clearly  documented  process 

-  Helps  identify  specific  actions  needed  to  reduce  programmatic  risk 

-  Complements  DOE  Design  Oversight  Process 

•  TRAs  are  a  “finding  of  fact”. 

-  Specified  criteria  (e.g.  “Nolte  Calculator”)  essential  to  ensure  consistency  in 
assessments 

•  TRL  Levels  usually  higher  when  strong  technology  program  is  completed, 
e.g.  “make  technology”. 

-  Choices  to  “buy  technology”  or  “engineer  technology”  without  testing  have  led  to 
lower  TRLs. 


“Relevant  Environment”  and  “Prototypic  Testing”  are  critical  concepts  in 


TRA. 


-  Practical  difficulties  and  limitations  of  large  scale  testing  with  actual  wastes  with 
increased  cost,  complexity  and  risk  may  outweigh  its  value 

-  Project  design  must  mature  with  technology  to  ensure  that  testing  is  relevant. 
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Next  Steps  Planned  for  WTP 


Assess  Readiness  of  WTP  Software  Systems 

Modify  “Nolte  Calculator”  to  support  assessment  of  Readiness  for 
Cold/Hot  Commissioning  (TRL  Level  7/8) 


Backup 
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Hanford  Cleanup  Site 


(iiihle  L 
Mo  until  in 


Cable  Hutte 


100  Areas 


Columbia 


Rich  I  Linds 
300  Area, 


* 


Rattlesnake 

Mountain 


Ni  a  in  Sruk 


1.  300  Area  Liquid  Effluent  Treatment  Facility 

2.  Commercial  Operating  Nuclear  Power  Plant 

3.  Fast  Flux  Test  Facility 

4.  Observatory 

5.  Laser  Interferometer  Gravitational 
Wave  Observatory 

6.  Old  Hanford  Town  Site 

7.  Plutonium  Uranium  Extraction  Plant 

8.  B  Plant 

9.  Prototype  Engineered  Barrier 

10.  200  East  Area  Effluent  Treatment  Facility 

11.  U.S.  Ecology  Commercial  Solid  Waste  Site 

12.  Environmental  Restoration  and  Storage  Facility 

13.  Waste  Encapsulation  and  Storage  Facility 

14.  REDOX 

15.  U  Plant 

16.  T  Plant 

17.  Waste  Treatment  Plant 

18.  Waste  Receiving  and  Processing  Facility 

19.  F  Reactor 

20.  H  Reactor 

21.  D  and  DR  Reactors 

22.  N  Reactor 

23.  KE  and  KW  Reactors 

24.  B  and  C  Reactors 
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ance  of  Facilities 


Determination  of  Critical  Technology  Elements  (CTEs) 


CTE  assessment  completed  for 
all  WTP  Process  and  Process 
Support  Systems  for  each 
facility 

CTEs  determined  by  response 
to  two  sets  of  questions 

Must  have  positive  response  to 
at  least  one  question  in  each 
question  set  for  determination 
as  CTE 

CTE’s  to  be  evaluated  with 
Technology  Readiness  Levels 


First  Question  Set 

Does  the  technology  directly  impact  a  functional 
requirement  of  the  process  or  facility? 

Do  limitations  in  the  understanding  of  the 
technology  result  in  a  potential  schedule  risk,  i.e., 
the  technology  may  not  be  ready  for  insertion 
when  required? 

Do  limitations  in  the  understanding  of  the 
technology  result  in  a  potential  cost  risk,  i.e.,  the 
technology  may  cause  significant  cost  overuns  ? 

Are  there  uncertainties  in  the  definition  of  the  end 
state  requirements  for  this  technology  ? 


Second  Question  Set 

Is  the  Technology  New  or  Novel? 

Is  the  Technology  modified? 

Has  the  technology  been  repackaged  so  a  new 
relevant  environment  is  realized? 

Is  the  technology  expected  to  operate  in  an 
environment  and/or  achieve  performance  beyond 
its  original  design  intention  or  demonstrated 
capability? 
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TRL  Requirements  and  Definitions 


Scale 

Full  Plant  Scale 

Matches  final  application 

Engineering  Scale 

Typical  (1/10  <  system  <  Full  Scale) 

Laboratory/Bench  Scale 

<1/10  Full  Scale 

System  Fidelity 

Identical  System  Configuration  -  matches  final  application  in  all  respects 

Similar  System  Configuration  -  matches  final  application  in  almost  all 

respects 

Pieces  -System  matches  a  piece  or  pieces  of  the  final  application 
Paper  -  System  exists  on  paper  -  no  hardware  system 


Environment  (Waste) 

Operational  (Full  Range) 

Full  range  of  actual  waste 

Operational  (Limited  Range) 

Limited  range  of  Actual  waste 

Relevant 

Simulants  +  a  limited  range  of  actual  wastes 

Simulated 

Range  of  simulants 

Testing  Requirements  for  TRLs 


TRL  Level 

Scale  of  Testing 

Fidelity 

Environment 

9 

Full 

Identical 

Operational 
(Pull  Range) 

8 

Full 

Identical 

Operational  (Limited  Range) 

7 

Full 

Similar 

Relevant 

6 

Engineering/Pilot 

Scale 

Similar 

Relevant 

5 

Lab/Bench 

Similar 

Relevant 

4 

Lab 

Pieces 

Simulated 

3 

Lab 

Pieces 

Simulated 

2 

Paper 

1 

Paper 

TRL  Calculator  Key 


•  H-Hardware  element,  contains  no  appreciable 
amount  of  software 

•  S-Completely  a  Software  system 

•  B-Some  Hardware  and  Software 

•  T-Technology,  technical  aspects 

•  M-Manufacturing  and  quality 

•  P  Programmatic,  customer  focus,  documentation 


TRL  Calculator-Top  Level  View  Questions 


TOP  LEVEL  VIEW  —  Demonstration  Environment  (Start  at  top  and  pick  the  first  correct  answer) 

O 

Has  the  actual  equipment/process  successfully  operated  in  the  full  operational  environment  (Hot  Operations)? 

O 

Has  the  actual  equipment/process  successfully  operated  in  a  limited  operational  environment  (Hot  Commissioning)? 

o 

Has  the  actual  equipment/process  successfully  operated  in  the  operational  environment  (Hot  Commissioning)? 

o 

Has  the  actual  equipment/process  successfully  operated  in  the  relevant  operational  environment(Cold  Commissioning)? 

o 

Has  a  prototypic  equipment/process  system  demonstrated  in  a  revelant  environment  (Cold  Pilot  Plant)? 

T3 

Has  bench  scale  equipment/process  testing  been  demonstrated  in  a  revelant  environment? 

O 

Has  laboratory  scale  testing  of  similar  equipment  systems  been  completed  in  a  simulated  environment? 

O 

Has  equipment  and  process  analysis  and  proof  of  concept  been  demonstrated  in  a  simulated  environment? 

O 

Has  an  equipment  and  process  concept  been  formulated? 

O 

Have  the  basic  process  technology  process  princples  been  observed  and  reported? 

O 

None  of  the  above 
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TRL  Calculator-Level  1  Questions 


H/SW 

Both 

Ques  I  I- -  ■  Do  y°Ul  want  to 

Catgry 

%  Complete 

TRL  1  (Check  all  that  apply  or  use  slider  for  %  complete) 

B 

T 

2 

► 

□ 

"Back  of  envelope"  environment 

B 

T 

4 

► 

□ 

Physical  laws  and  assumptions  used  in  new  technologies  defined 

S 

T 

4 

► 

□ 

Have  some  concept  in  mind  for  software  that  may  be  realizable  in  software 

S 

T 

2 

► 

□ 

Know  what  software  needs  to  do  in  general  terms 

B 

T 

~4] 

► 

□ 

Paper  studies  confirm  basic  principles 

S 

T 

4 

► 

□ 

Mathematical  formulations  of  concepts  that  might  be  realizable  in  software 

S 

T 

4 

► 

□ 

Have  an  idea  that  captures  the  basic  principles  of  a  possible  algorithm 

B 

P 

2 

► 

— 

Initial  scientific  observations  reported  in  journals/conference  proceedings/technical  reports 

B 

T 

2 

► 

— 

Basic  scientific  principles  observed 

B 

P 

4 

► 

_ 

Know  who  cares  about  technology,  e.g.,  sponsor,  money  source 

B 

T 

4 

► 

Research  hypothesis  formulated 

B 

P 

2 

□ 

Know  who  will  perform  research  and  where  it  will  be  done 
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TRL  Calculator-Level  2  Questions 


H/SW 

Ques 

Both 

Catgry 

%  Complete 

TRL  2  (Check  all  that  apply  or  use  slider  for  %  complete) 

B 

P 

^1 

► 

□ 

Customer  identified 

B 

T 

< 

U 

Potential  system  or  component  application(s)  have  been  identified 

B 

T 

«J 

1  IT] 

□ 

Paper  studies  show  that  application  is  feasible 

B 

P 

◄ 

□ 

Know  what  program  the  technology  will  support 

B 

T 

4 

► 

□ 

An  apparent  theoretical  or  empirical  design  solution  identified 

H 

T 

2 

► 

□ 

Basic  elements  of  technology  have  been  identified 

B 

T 

◄ 

► 

□ 

Desktop  environment 

H 

T 

4 

► 

□ 

Components  of  technology  have  been  partially  characterized 

H 

T 

4 

► 

□ 

Performance  predictions  made  for  each  element 

B 

P 

► 

□ 

Customer  expresses  interest  in  application 

S 

T 

2 

► 

□ 

Some  coding  to  confirm  basic  principles 

B 

T 

4 

► 

□ 

Initial  analysis  shows  what  major  functions  need  to  be  done 

H 

T 

4 

► 

□ 

Modeling  &  Simulation  only  used  to  verify  physical  principles 

B 

P 

4 

► 

□ 

System  architecture  defined  in  terms  of  major  functions  to  be  performed 

S 

T 

2 

► 

□ 

Experiments  performed  with  synthetic  data 

B 

P 

4 

1  ► 

□ 

Requirement  tracking  system  defined  to  manage  requirements  creep 

B 

T 

4 

a 

□ 

Rigorous  analytical  studies  confirm  basic  principles 

B 

P 

~4 

i  t 

□ 

Analytical  studies  reported  in  scientific  journals/conference  proceedings/technical  reports 

B 

T 

4 

i  Ii 

□ 

Individual  parts  of  the  technology  work  (No  real  attempt  at  integration) 

S 

T 

2 

□ 

Know  what  hardware  software  will  be  hosted  on 

B 

T 

◄ 

I  ► 

□ 

Know  what  output  devices  are  available 

B 

P 

◄ 

|  ► 

□ 

Preliminary  strategy  to  obtain  TRL  Level  6  developed  (e.g  scope,  schedule,  cost) 

B 

P 

4 

|  ► 

□ 

Know  capabilities  and  limitations  of  researchers  and  research  facilities 

B 

T 

4 

|  ► 

□ 

Know  what  experiments  are  required  (research  approach) 

B 

P 

4 

|  ► 

□ 

Qualitative  idea  of  risk  areas  (cost,  schedule,  performance) 
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TRL  Calculator-Level  3  Questions 


H/SW 

Ques  1  — 

Both 

Catgry 

%  Complete 

TRL  3  (Check  all  that  apply  or  use  slider  for  %  complete) 

B 

T 

«ii  m> 

□ 

Academic  environment 

H 

T 

4 

► 

□ 

Predictions  of  elements  of  technology  capability  validated  by  Analytical  Studies 

B 

P 

jiJ 

► 

□ 

The  base  science  has  been  validated  at  the  laboratory  scale  j 

H 

T 

T 

► 

□ 

Science  known  to  extent  that  mathematical  and/or  computer  models  and  simulations  are  possible 

H 

P 

► 

□ 

Preliminary  system  performance  characteristics  and  measures  have  been  identified  and  estimated 

S 

T 

4 

► 

□ 

Outline  of  software  algorithms  available 

H 

T 

► 

□ 

Predictions  of  elements  of  technology  capability  validated  by  Modeling  and  Simulation  (M&S) 

S 

T 

4 

□ 

Preliminary  coding  verifies  that  software  can  satisfy  an  operational  need 

H 

M 

< 

1 

H 

□ 

No  system  components,  just  basic  laboratory  research  equipment  to  verify  physical  principles 

B 

T 

4 

► 

□ 

Laboratory  experiments  verify  feasibility  of  application 

H 

T 

4 

► 

□ 

Predictions  of  elements  of  technology  capability  validated  by  Laboratory  Experiments 

B 

P 

4 

► 

□ 

Customer  representative  identified  to  work  with  development  team 

B 

P 

► 

□ 

Customer  participates  in  requirements  generation 

B 

T 

► 

□ 

Cross  technology  effects  (if  any)  have  begun  to  be  identified 

H 

M 

4 

► 

□ 

Design  techniques  have  been  identified/developed 

B 

T 

► 

□ 

Paper  studies  indicate  that  system  components  ought  to  work  together 

B 

P 

► 

□ 

Customer  identifies  transition  window(s)  of  opportunity 

B 

T 

H 

► 

□ 

Performance  metrics  for  the  system  are  established 

B 

P 

2 

► 

□ 

Scaling  studies  have  been  started 

S 

T 

4 

1  ► 

□ 

Experiments  carried  out  with  small  representative  data  sets 

S 

T 

~4 

1  1  ► 

□ 

Algorithms  run  on  surrogate  processor  in  a  laboratory  environment 
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TRL  Calculator-Level  3  Questions  (continued) 


H/SW 

Ques 

Both 

Catgry 

%  Complete 

TRL  3  (Check  all  that  apply  or  use  slider  for  %  complete) 

H 

M 

<1  ■>! 

□ 

Current  manufacturability  concepts  assessed 

S 

T 

ii  ► 

□ 

Know  what  software  is  presently  available  that  does  similar  task  (100%  =  Inventory  completed) 

S 

T 

I  Ll 

□ 

Existing  software  examined  for  possible  reuse 

H 

M 

i  E 

□ 

Sources  of  key  components  for  laboratory  testing  identified 

S 

T 

► 

□ 

Know  limitations  of  presently  available  software  (Analysis  of  current  software  completed) 

B 

T 

□ 

Scientific  feasibility  fully  demonstrated 

B 

T 

► 

□ 

Analysis  of  present  state  of  the  art  shows  that  technology  fills  a  need 

B 

P 

4 

► 

□ 

Risk  areas  identified  in  general  terms 

B 

P 

4 

► 

□ 

Risk  mitigation  strategies  identified 

B 

P 

4 

► 

□ 

Rudimentary  best  value  analysis  performed  for  operations 

B 

P 

4 

► 

□ 

The  individual  system  components  have  been  tested  at  the  laboratory  scale 
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TRL  Calculator-Level  4  Questions 


H/SW 

Ques 

Both 

Catgry 

%  Complete 

TRL  4  (Check  all  that  apply  or  use  slider  for  %  complete) 

B 

T 

3 

► 

□ 

Cross  technology  issues  (if  any)  have  been  fully  identified 

H 

M 

3 

► 

□ 

Laboratory  components  tested  are  surrogates  for  system  components 

H 

T 

4 

► 

□ 

Individual  components  tested  in  laboratory/by  supplier  (contractor's  component  acceptance  testing) 

B 

T 

► 

□ 

Subsystems  composed  of  multiple  components  tested  at  lab  scale  using  simulants 

H 

T 

3 

► 

□ 

M&S  used  to  simulate  some  components  and  interfaces  between  components 

S 

T 

► 

□ 

Formal  system  architecture  development  begins 

B 

P 

n 

► 

□ 

Customer  publishes  requirements  document 

B 

T 

4 

► 

□ 

Overall  system  requirements  for  end  user's  application  are  known 

B 

P 

4 

► 

□ 

System  performance  metrics  have  been  established 

S 

T 

□ 

Analysis  provides  detailed  knowledge  of  specific  functions  software  needs  to  perform 

B 

P 

il 

► 

□ 

Laboratory  requirements  derived  from  system  requirements  are  established 

H 

M 

4 

► 

□ 

Available  components  assembled  into  laboratory  scale  system 

H 

T 

4 

□ 

Laboratory  experiments  with  available  components  show  that  they  work  together  (lab  kludge) 

S 

T 

4 

Z 

□ 

Requirements  for  each  system  function  established 

S 

T 

T 

□ 

Algorithms  converted  to  pseudocode 

S 

T 

\y 

□ 

Analysis  of  data  requirements  and  formats  completed 

S 

T 

4 

□ 

Stand-alone  modules  follow  preliminary  system  architecture  plan 

H 

T 

4 

□ 

Analysis  completed  to  establish  component  compatibility 

S 

M 

4 

[I 

□ 

Designs  verified  through  formal  inspection  process 

B 

P 

► 

□ 

Science  and  Technology  exit  criteria  established 

B 

T 

ii  ► 

□ 

Technology  demonstrates  basic  functionality  in  simulated  environment 

S 

P 

4 

► 

□ 

Able  to  estimate  software  program  size  in  lines  of  code  and/or  function  points 

H 

M 

4 

► 

□ 

Scalable  technology  prototypes  have  been  produced 

B 

P 

T 

□ 

Draft  conceptual  designs  have  been  documented 

H 

M 

e 

□ 

Equipment  scaleup  relationships  are  understood/accounted  for  in  technology  development  program 
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TRL  Calculator-Level  4  Questions  (continued) 


H/SW 

Both 

Ques  1 
Catgry  ] 

1 

%  Complete 

TRL  4  (Check  all  that  apply  or  use  slider  for  %  complete) 

B 

T 

B 

s 

□ 

Controlled  laboratory  environment  used  in  testing 

B 

P 

m 

M 

□ 

Initial  cost  drivers  identified 

S 

T 

< 

□ 

Experiments  with  full  scale  problems  and  representative  data  sets 

B 

M 

4 

M 

Integration  studies  have  been  started 

B 

P 

0 

Z 

□ 

Formal  risk  management  program  initiated 

S 

T 

4  ► 

□ 

Individual  functions  or  modules  demonstrated  in  a  laboratory  environment 

H 

M 

~4\ 

1  ► 

□ 

Key  manufacturing  processes  for  equipment  systems  identified 

B 

P 

4 

1  ► 

□ 

Scaling  documents  and  designs  of  technology  have  been  completed 

S 

T 

4 

1  P" 

□ 

Some  ad  hoc  integration  of  functions  or  modules  demonstrates  that  they  will  work  together 

H 

M 

<1 

□ 

Key  manufacturing  processes  assessed  in  laboratory 

B 

P 

<11  ► 

n 

Functional  work  breakdown  structure  developed 

B 

T 

Ml  ► 

□ 

Low  fidelity  technology  “system”  integration  and  engineering  completed  in  a  lab  environment 

H 

M 

M 

1  ► 

□ 

Mitigation  strategies  identified  to  address  manufacturability  /  producibility  shortfalls 

B 

P 

4 

1  JZ 

□ 

Technology  availability  dates  established 

B 

T 

4 

i  1m 

□ 

Functional  work  breakdown  structure  developed 
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TRL  Calculator-Level  5  Questions 


H/SW 

Ques 

^ ■ 

Both 

Catgry 

%  Complete 

TRL  5  (Check  all  that  apply  or  use  sliders) 

B 

T 

Mil  ■  ► 

□ 

Cross  technology  effects  (if  any)  have  been  fully  identified 

B 

T 

Q 

m 

U 

Plant  size  components  available  for  testing 

B 

T 

0 0 

□ 

System  interface  requirements  known 

B 

P 

4 

0 

□ 

System  requirements  flow  down  through  work  breakdown  structure  (systems  engineering  begins) 

S 

T 

4 

► 

□ 

System  software  architecture  established 

B 

T 

4  ► 

□ 

Requirements  for  technology  verification  established 

S 

T 

<1 

□ 

External  process/equipment  interfaces  described  as  to  source,  structure,  and  requirements 

S 

T 

<1! 

□ 

Analysis  of  internal  system  interface  requirements  completed 

B 

T 

4  |  ► 

□ 

Lab  scale  similar  system  tested  with  limitied  range  of  actual  wastes 

B 

T 

□ 

Interfaces  between  components/subsystems  are  realistic  (benchtop  with  realistic  interfaces) 

H 

M 

0 

0 

□ 

Significant  engineering  and  design  changes 

S 

T 

Mil  ► 

□ 

Coding  of  individual  functions/modules  completed 

H 

M 

<1  ► 

□ 

Prototypes  have  been  created 

H 

M 

0 

► 

□ 

Tooling  and  machines  demonstrated  in  lab 

B 

T 

mi  0 

□ 

High  fidelity  lab  integration  of  system  completed,  ready  for  test  in  revelant  environments 

H 

M 

0 

► 

□ 

Design  techniques  have  been  defined  to  the  point  where  largest  problems  defined 

H 

P 

4\  ► 

□ 

Lab  scale  similar  system  tested  with  range  of  simualnts 

H 

T 

~4\ 

l  ► 

□ 

Fidelity  of  system  mock-up  improves  from  laboratory  to  benchscale  testing 

B 

M 

4 

1  H 

□ 

Availability  and  reliability  target  levels  not  yet  established 

H 

M 

4 

1  ► 

□ 

Some  special  purpose  components  combined  with  available  laboratory  components 
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TRL  Calculator-Level  5  Questions  (continued) 


H/SW 

Both 

Ques 

Catgry 

1 

%  Complete 

TRL  5  (Check  all  that  apply  or  use  sliders) 

H 

P 

<11  ► 

□ 

Three  dimensional  drawings  and  P&IDs  diagrams  have  been  prepared 

B 

T 

4 

► 

□ 

Laboratory  environment  for  testing  modified  to  approximate  operational  environment 

B 

T 

4 

► 

□ 

Component  integration  issues  and  requirements  identified 

H 

P 

4 

► 

□ 

Detailed  design  drawings  have  been  completed 

B 

T 

4 

► 

□ 

Requirements  definition  with  performance  thresholds  and  objectives  established 

S 

T 

«|  ► 

□ 

Algorithms  run  on  processor  with  characteristics  representative  of  target  environment 

B 

T 

«j  ► 

□ 

Preliminary  technology  feasibility  engineering  report  completed 

B 

T 

◄ 

► 

□ 

Integration  of  modules/functions  demonstrated  in  a  laboratory  environment 

B 

T 

◄ 

► 

□ 

Formal  inspection  of  all  modules/components  completed  as  part  of  configuration  management 

B 

P 

4 

► 

□ 

Configuration  management  plan  in  place 

B 

P 

4 

► 

□ 

Risk  management  plan  documented 

S 

T 

4  |  ► 

□ 

Functions  integrated  into  modules 

B 

P 

Ml 

□ 

Configuration  management  plan  in  place 

S 

T 

4 

► 

□ 

Individual  functions  tested  to  verify  that  they  work 

S 

T 

4 

► 

□ 

Individual  modules  and  functions  tested  for  bugs 

S 

T 

4 

► 

□ 

Integration  of  modules/functions  demonstrated  in  a  laboratory  environment 

S 

P 

Ml  ► 

□ 

Formal  inspection  of  all  modules/components  completed  as  part  of  configuration  management 

B 

P 

r<  i  i  ► 

□ 

Configuration  management  plan  documented 

B 

T 

<i  ► 

□ 

Risk  management  plan  documented 

B 

T 

4 

► 

□ 

Functions  integrated  into  modules 

H 

P 

4 

► 

□ 

Individual  process  and  equipment  functions  tested  to  verify  that  they  work 
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TRL  Calculator-Level  6  Questions 


H/SW 

Both 

Ques 

Catgry 

%  Complete 

TRL  6  (Check  all  that  apply  or  use  sliders) 

B 

T 

< 

|  ► 

□ 

Cross  technology  issue  measurement  and  performance  characteristic  validations  completed 

H 

M 

4 

|  ► 

□ 

Availability  (reliability,  maintainability)  levels  established 

B 

M 

4 

|  ► 

□ 

Frequent  design  changes  occur 

H 

P 

4 

|  ► 

□ 

Draft  design  drawings  are  nearly  complete 

B 

T 

4 

|  ► 

□ 

Operating  environment  for  eventual  system  known 

B 

P 

«l 

► 

□ 

Collection  of  actual  maintainability,  reliability,  and  supportability  data  has  been  started 

B 

P 

«l 

□ 

Design  to  cost  goals  identified 

B 

T 

«l 

► 

□ 

Engineering  scale  similar  system  tested  with  a  range  of  simulants 

B 

T 

«l 

► 

□ 

Modeling  and  Simulation  used  to  simulate  system  performance  in  an  operational  environment 

B 

P 

4 

II 

► 

□ 

Plan  for  demonstration  of  prototypical  equipment  and  process  testing  completed,  results  verify  design 

H 

T 

4 

1  ► 

□ 

Operating  limts  determined  using  engineering  scale  system 

B 

T 

4 

1  ► 

□ 

Representative  model  /  prototype  tested  in  high-fidelity  lab  /  simulated  operational  environment 

B 

P 

4 

i  L 

□ 

Formal  requirements  document  available 

B 

P 

4 

i  ► 

□ 

Off-normal  operating  responses  determined  for  engineering  scale  system 

B 

T 

«l 

► 

□ 

Systen  technical  interfaces  defined 

B 

T 

«l 

► 

□ 

Component  integration  demonstrated  at  an  engineering  scale 

B 

P 

«l 

► 

□ 

Scaling  issues  that  remain  are  identified  and  supporting  analysis  is  complete 

B 

P 

«l 

► 

□ 

Analysis  of  project  timing  ensures  technology  will  be  available  when  required 

S 

T 

<1 

► 

□ 

Analysis  of  database  structures  and  interfaces  completed 

B 

P 

4 

V 

□ 

Flave  begun  to  establish  an  interface  control  process 

B 

P 

<\ 

V 

□ 

Acquisition  program  milestones  established 

H 

M 

<\ 

► 

□ 

Critical  manufacturing  processes  prototyped 

H 

M 

«l 

a 

□ 

Most  pre-production  hardware  is  available 
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TRL  Calculator-Level  6  Questions  (continued) 


H/SW 

Both 

Ques 

Catgry 

%  Complete 

TRL  6  (Check  all  that  apply  or  use  sliders) 

B 

T 

◄ 

► 

□ 

Engineering  feasibility  fully  demonstrated 

S 

T 

◄ 

► 

□ 

Prototype  implementation  includes  functionality  to  handle  large  scale  realistic  problems 

S 

T 

4 

► 

□ 

Algorithms  parially  integrated  with  existing  hardware  /  software  systems 

H 

M 

4 

► 

□ 

Materials,  process,  design,  and  integration  methods  have  been  employed 

S 

T 

4 

► 

□ 

Individual  modules  tested  to  verify  that  the  module  components  (functions)  work  together 

B 

P 

4 

► 

□ 

Technology  ’’system”  specification  complete 

H 

M 

4 

► 

□ 

Components  are  functionally  compatible  with  operational  system 

S 

T 

4 

► 

□ 

Representative  software  system  or  prototype  demonstrated  in  a  laboratory  environment 

B 

T 

4 

► 

□ 

Engineering  scale  system  is  high-fidelity  functional  prototype  of  operational  system 

B 

P 

[4 

► 

□ 

Formal  configuration  management  program  defined  to  control  change  process 

B 

M 

4 

► 

□ 

Integration  demonstrations  have  been  completed 

B 

P 

4 

► 

□ 

Final  Technical  Report  on  Technology  completed 

B 

T 

4 

► 

□ 

Processing  issues  have  been  identified  and  major  ones  have  been  resolved 

S 

T 

4 

► 

u 

Limited  software  documentation  available 

S 

P 

4 

► 

□ 

Verification,  Validation  and  Accreditation  (VV&A)  initiated 

H 

M 

4 

► 

□ 

Process  and  tooling  are  mature 

H 

M 

4 

► 

□ 

Production  demonstrations  are  complete 

B 

T 

4 

► 

□ 

"Alpha"  version  software  has  been  released 

B 

T 

4 

► 

□ 

Engineering  feasibility  fully  demonstrated 

B 

P 

4 

► 

□ 

Technology  ready  for  detailed  design  implementation 
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